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METHOD AND DEVICE FOR THE INTERACTIVE SIMULATION OF CONTACT 

BETWEEN OBJECTS 

The present invention relates to a method and a system 
5 for interactively simulating contact between a deformable 
object and a second object using a simulated model with a 
predetermined sampling time step. 

It has already been proposed to simulate measurements of 
interpenetration between a rigid object and a deformable 
10 object from estimated volumes or distances, in particular for 
virtual surgery applications in which a virtual rigid surgical 
tool cooperates with a virtual deformable organ of the human 
body. 

However, in the above methods the relationship between 
15 the interpenetration measurement and the reaction contact 
forces has no physical basis and artificial forces may be 
applied to nodes of the meshes of the objects that are not in 
contact, which compromises reliability since the contact 
forces do not comply with the conditions of the Signorini 
2 0 problem. 

The present invention aims to eliminate the above- 
mentioned drawbacks and to provide interactive real-time 
simulation of contact between objects, at least some of which 
are deformable, in a simpler and economic manner, while 

2 5 simultaneously complying with the constraints of the laws of 

physics that govern such contact, so that the simulated 
contact between objects is reliable, and the stability of the 
simulation is therefore guaranteed. 

The above objects are achieved by a method of 

3 0 interactively simulating contact between a deformable first 

object and a second object using a simulated model with a 
predetermined sampling time step, the method being 
characterized in that: 
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(a) the parameters describing the physical 

characteristics of each of the objects, such as the geometry 
and the mechanics of the materials of each of the objects, are 
calculated beforehand and stored in a memory, 
5 (b) at the beginning of each sampling time step of the 

simulated model, a real-time analysis of the inherent behavior 
of each object is carried out at the level of each object in 
order to predict the positions, speeds and accelerations of 
that object in application of a free movement that does not 
10 take account of any subsequent contacts, 

(c) in each sampling time step of the simulated model, 
pairs of objects that are detected as intersecting are 
analyzed in real time at the level of an overall scene 
including the objects liable to come into contact, and a list 

15 of groups of collisions is established that contains a string 
of objects in collision and a description of the collisions, 

(d) in each sampling time step of the simulated model, 
parameters representing the physical characteristics of the 
objects and the description of the collisions are repatriated 

2 0 in real time for each group of collisions to determine, for 
each instance, the solution to the Signorini problem that 
governs contact between two objects in the case of pure 
relative sliding, 

(e) at the end of each sampling time step of the 

2 5 simulated model, a real-time display of the inherent behavior 

of the object following the collision is effected at the level 
of each object, and 

(f) all real-time processing is effected with a 
computation time step shorter than the sampling time step of 

3 0 the simulated model so as to define an interactive simulation 

in which the user can intervene directly during simulation. 

During the step a) of calculating beforehand parameters 
describing the physical characteristics of each of the 
objects, a finite element type description of deformations is 
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used for the parameters describing the mechanics of the 
materials, with matrices being filled and inverted systems of 
equations being solved, and data being stored in memory. 

In one particular embodiment, each object is described in 
5 a rest configuration as a set of triangles reproducing its 
surface and a set of tetrahedra describing the interior of the 
obj ect . 

Each triangle is advantageously described by three points 
placed in an order such that normals are calculated that are 
10 invariably directed towards the exterior of the object. 

The deformations of the objects are preferably 
interpolated by the finite element method using a linear 
tetrahedral mesh. 

In each computation time step the explicit forces applied 
15 to an object, which are already known at the start of the 
computation step, are integrated during the step b) at object 
level to define the movements of the object that they 
generate, whereas the values of the implicit contact forces, 
which depend on the movement of the objects in the computation 

2 0 time step, are determined during the step d) of seeking the 

solution to the Signorini problem at the level of an overall 
scene . 

During the step c) of analysis at the level of an overall 
scene, the existing intersections between the objects of the 
25 scene are detected geometrically in order to extract from 
pairs of elements of intersecting objects a length and a 
direction of interpenetration between the two elements of a 
pair of elements of objects. 

In one implementation, during the step c) of analysis at 

3 0 the level of an overall scene, to extract from pairs of 

elements of intersecting objects a length and a direction of 
interpenetration between the two elements of a pair of 
elements of objects, an intermediate movement of the objects 
between the preceding computation step and the current 
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computation step is also taken into account in order to 
compute a preferential direction of interference between the 
objects . 

During the step d) of seeking the solution to the 
5 Signorini problem, the extreme points of application of the 
contact force between the two objects in collision are 
reconstructed if those extreme application points have not 
been determined during the preceding step. 

In one particular implementation, during the step d) of 

10 seeking the solution to the Signorini problem, in the case of 
a segment -segment intersection of two triangular objects, the 
two points selected to constitute the extreme points of 
application of the contact force between the two objects in 
collision are situated at the intersection of each of the two 

15 segments with the plane formed by the face of the triangle in 
the intersection. 

In another particular implementation, during the step d) 
of seeking the solution to the Signorini algorithm, in the 
case of a point- face intersection of two triangular objects, a 

2 0 first point selected to constitute an extreme point of 
application of the contact force between the two objects in 
collision is the point of the intersection whereas the second 
extreme point of application of the contact force between the 
two objects in collision is the projection of the first 

2 5 extreme point onto the face of the triangle in the 

intersection. 

According to one particular aspect of the invention, 
barycentric coordinates are used to distribute the 
displacements and the forces of the points of application of 

3 0 the contact force between the extreme points of application of 

the contact force by effecting a linear interpolation for a 
finite element modeling process. 

In particular, the distance 5 of interpenetration between 
the two extreme points of application of the contact force in 
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the case of a segment -segment contact between a first segment 
and a second segment of a second triangle may be calculated 
from the following equation: 



5 = [a s b s cj 



[a 1 



[P i-p] 
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in which: 

a and 1 - a are the barycentric coordinates on the first 
segment , 

P and 1 - P are the barycentric coordinates on the second 
10 segment, 

ai bi c± are the coordinates of the interpenetration direction 
ni, 

Wi and W 2 are the coordinates of the first segment, 
Vi and V 2 are the coordinates of the second segment . 
15 The distance 5 of interpenetration between the two 

extreme points of application of the contact force in the case 
of a point -plane contact between a point of a second triangle 
and a plane of a first triangle may be calculated from the 
following equation: 

(2) 

L W 3 J 

in which: 

a, P and y are the barycentric coordinates on the first 
triangle , 

ai b± Ci are the coordinates of the interpenetration direction 
25 n i# 

Wi, W 2 , W 3 are the coordinates of the first triangle, 

Vi represents the coordinates of the point of contact 

consisting of a vertex of the second triangle. 

When the points of application of the contact forces 
3 0 between two objects in collision have been determined, during 
the step d) the mechanical characteristics of the objects are 
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transferred into the defined contact space in which the whole 
of a group of m contacts with n objects is processed, where m 
and n are integers . 

In particular, during the step d) the mass and inertia of 
5 an object are considered lumped together at its centre of mass 
and an instantaneous relationship between the contact forces f c 
in the contact direction, the accelerations 8" c caused by the 
constraints in the same direction, and the free accelerations 
8" free in the same direction known during the step c) at the 
10 level of an overall scene is established from the equation: 

£" c = JcM-'j/f^^free (3) 

in which: 

J c is an m*6n Jacobean matrix that transfers the instantaneous 
linear and angular movement into the contact space, 

15 J C T is the transposed matrix of J c , 

M is a block diagonal matrix corresponding to the mass and 
inertia of the n objects of the group of contacts. 

During the step d) , to transport the local mechanical 
characteristics, a relationship is established between: 

20 • the displacement difference (Uk 1 ) of the points of the 
deformable mesh representing the object i at the time k, 
between the free deformation (uVfree) and the constrained 
deformation (U^c) / in other words Uk 1 = U x k fC - U^free 
• the free and constrained relative positions 8 fre e and 8 C of 

25 the objects in the contact space: 

5 = Si=i n N c j IV + 5 free (4) 
where is a matrix for passing from the displacement space 

of the mesh to the displacement space of the contacts. 

Similarly, a relationship is established between the 
3 0 forces in the contact space f c and the forces in the 
deformation forces space F k : 
F k = (N c i ) T / c (5) 
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In particular, during the step d) an instantaneous linear 
relationship characterizing contact deformations or 
displacements 5 C from the contact forces f c and the free 
displacements 8"f re e caused by free movements integrating only 
5 the forces known explicitly at the beginning of the 
computation time step is established from the following 
equation: 

S c = [s i=1 n N c > A (U k .,) (N^) 7 ] / c + bfree ( 6 ) 
in which: 

10 N 3 ^ is a matrix for passing from the displacement space of the 
mesh to the displacement space of the contacts, 
(N^) T is the transposed matrix of N^, 

A is a matrix defining the deformation of the object at the 
local level, such that if U k represents the vector of the 

15 displacement in the local frame of reference of the object at 
the current time and U k -i represents the displacement vector in 
the local frame of reference of the object in the preceding 
calculation step, the instantaneous values whereof are known 
at the beginning of the current computation step, then: 

20 U K = A (Uk-i) F k + b (U k _x) (7) 

where : 

F k is a vector representing the external forces applied to the 

object expressed in the local frame of reference, and 

b is a vector that has a value in the displacement space and 

25 depends on the object deformation model. 

In a more general case , during the step d) an 
instantaneous relationship characterizing the contact 
deformations or displacements 5 C from the contact forces f c and 
the free displacements 5" fr ee caused by free movements 

3 0 integrating only the forces known explicitly at the beginning 
of the computation time step is established from the following 
equation: 

S c « [e dt 2 J c M" 1 J C T +L i=1 n N C J A (U k _,) (NcY ] / c + Sfr ee (8) 
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in which: 

J c is an m*6n Jacobean matrix that transfers the instantaneous 
linear and angular movement into the contact space, 
J C T is the transposed matrix of J c , 
5 M is a block diagonal matrix corresponding to the mass and 
inertia of the n objects of the group of contacts, 
9 is a constant depending on the time integration method, 
N^c is a matrix for passing from the displacement space of the 
mesh to the displacement space of the contacts, 

10 (N^) 1 " is the transposed matrix of N^c, 

A is a matrix defining the deformation of the object at the 
local level such that if U k represents the vector of the 
displacement in the local frame of reference of the object at 
the current time and U k _i represents the displacement vector in 

15 the local frame of reference of the object in the preceding 
calculation step the instantaneous values whereof are known at 
the beginning of the current computation step, then: 

U K = A (U k -!) F k + b (U k -!) (7) 
where : 

2 0 F k is a vector representing the external forces applied to the 
object expressed in the local frame of reference, and 
b is a vector that has a value in the displacement space and 
depends on the object deformation model. 

The method according to the invention advantageously 

2 5 further comprises a step of coupling with a haptic interface 

module to produce haptic sensation feedback to a mechanical 
system by means of which an operator manipulates the objects 
in a virtual scene. 

The invention also provides a system for interactively 

3 0 simulating contact between a deformable first object and a 

second object using a simulated model with a predetermined 
sampling time step, the system being characterized in that it 
comprises : 
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(a) a module for calculating beforehand parameters 
describing the physical characteristics of each of the 
objects, such as the geometry and the mechanics of the 
materials of each of the objects, 
5 (b) a memory for storing parameters previously 

calculated in the computation module, 

(c) a coupling module to a user interface comprising a 
mechanical system held by a user to exert virtual forces on 
said objects in a scene of the simulated model, 
10 (d) a display screen for displaying said objects 

represented in the form of meshes, 

(e) a central processor unit associated with input 
means, comprising at least: 

el) an object analysis module for analyzing in real 
15 time at the level of each object the inherent behavior of 

the object in order to predict the positions, speeds and 
accelerations of that object in application of a free 
movement that does not take account of any subsequent 
contacts , 

2 0 e2) an analysis module for an overall scene 

including the objects liable to come into contact, for 
analyzing in real time pairs of objects that are detected 
to be interacting and to establish a list of groups of 
collisions that contains a string of objects in collision 
25 and a description of the collisions, 

e3) a module for the real time repatriation, for 
each group of collisions, of the parameters representing 
the physical characteristics of the objects and the 
description of the collisions, for determining, for each 

3 0 instance, the solution to the Signorini problem that 

governs contact between two objects in the case of pure 
relative sliding, 
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e4) a module for processing each object for real 
time display at the level of each object of the inherent 
behavior of that object following a collision, and 

e5) means for determining a computation step shorter 
5 than the sampling time step of the simulated model so as 

to define an interactive simulation. 

The system advantageously comprises means for producing 
haptic sensation feedback to the user interface. 
10 According to one advantageous feature, the computation 

step corresponds to a frequency greater than or equal to 
approximately 500 Hz. 



15 Other features and advantages of the invention emerge 

from the following description of particular embodiments of 
the invention provided by way of example, which description is 
given with reference to the appended drawings, in which: 

Figure 1 is a diagram showing the steps of a method of 

20 the invention for interactively simulating contact between 
objects , 

Figure 2 is a diagram showing different levels of 
processing of the interaction between objects during different 
steps of the Figure 1 simulation method, 
25 Figures 3A to 3C show three examples of interaction 

between two virtual objects represented by triangles, 

Figure 4 represents an interaction between two triangular 
objects in the case of a segment -segment intersection, 

Figure 5 represents an interaction between two triangular 
30 objects in the case of a point- face intersection, 

Figure 6 is a diagram of a collision between two objects 
for which the configuration can be defined by geometrical 
criteria alone, 
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Figure 7 is a diagram of a collision between two objects 
for which the configuration is defined taking account of an 
intermediate movement , 

Figure 8 is a block diagram showing the basic components 
5 of a system of the invention for interactively simulating 
contact between objects, 

Figure 9 shows one example of contact between a 
deformable virtual object and another virtual object, and 

Figures 10A to IOC show three different relative 
10 positions of a deformable virtual object in the form of 
forceps and a rigid virtual object during a process of 
placement of the deformable virtual object in the form of 
forceps on the rigid virtual object. 

15 Figure 8 is a diagram showing one example of a system for 

implementing the invention and interactively simulating 
contact between objects in real time at the same time as 
providing haptic sensation feedback. 

A simple processor unit 100, which may be based on a 

2 0 conventional computer, executes the various calculations 
necessary to perform a simulation. 

A display screen 107 connected to the computer 100 via a 
graphic interface displays objects represented in the form of 
a mesh comprising nodes or vertices connecting segments or 

25 edges. 

Information may be supplied to the computer 100 from a 
conventional user interface 103 that may comprise a keyboard 
and a mouse, for example, constituting input means. 

A dedicated mechanical system 104 held by a user and 
30 connected via a coupling module 101 to the computer 100 may 
additionally be provided so that the user can exert virtual 
forces on the objects in a scene of a simulated model. A 
mechanical system 104 of this kind and the coupling module 101 
constitute a haptic interface that enables the user to apply 
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forces to the virtual objects in the scene and to receive in 
return a haptic simulation that is a response to the 
simulation of the contact between objects. 

The computer 100 conventionally comprises a processor, a 
5 non- volatile memory for storing programs and data, and a 
working memory cooperating with the processor. External 
memory media (diskettes, CD-ROM, etc.) or a modem connected to 
a network may naturally be used to load into the computer 
programs or data for performing some or all of the simulation 

10 processing. In Figure 8 there is merely shown in symbolic 
form a storage memory 102 that cooperates with the module 100 
and may consist of one of the types of memory mentioned above. 

Generally speaking, at the start of a simulation the 
parameters describing the geometry and the mechanics of the 

15 materials of the objects to be simulated are computed in the 
central unit 10 0 and stored in a memory area of the memory 
102 . 

The processing performed by the central unit 100 uses a 
finite element type description of the mechanical deformations 
2 0 of the objects in order to characterize them. This processing 
entails filling and inverting matrices, solving systems of 
equations, and storing data in the memory 102 associated with 
the central unit 100. 

The current shapes and positions of the objects are 

2 5 evaluated as a function of the applied loads and the 

mechanical laws that govern the objects in the scene. 

To guarantee a stable simulation, the computation in 
accordance with the invention of the simulated contact between 
objects takes into account the laws of physics that govern 

3 0 such contact. To enable simulation in real time, i.e. with a 

very short and limited delay between a load applied by the 
user via the haptic interface 104, 101 and a response supplied 
to that haptic interface 104, 101 by the central processor 
unit 100, the simulation system uses three main modules that 
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are called iteratively in each sampling time step of the 
simulated model. Moreover, all real time processing is 
effected with a calculation time step shorter than the 
sampling time step of the simulated model. 
5 The three main modules of the simulation system 

implementing the various steps of the simulation method 
essentially take the following form: 

• A first or "mechanical" module, situated at the level 
of each object and describing its inherent behavior, causes 

10 the position and the shape of the object to evolve in 
accordance with the forces applied and the places at which 
they are applied. This module is called at the beginning of a 
calculation step to predict the positions, speeds and 
accelerations of the objects without taking account of the 

15 contact and is then called again to take account of the forces 
calculated in a third or "contact processing" module. 

• A second or ''collision detection" module, situated at 
the level of the overall scene, establishes pairs of objects 
that are detected as intersecting. This module may optionally 

2 0 create intermediate movements between the simulation steps to 

determine when and how the objects came to intersect. This 
module is governed primarily by optimized geometrical laws 
that accelerate the computation in order to obtain a string of 
objects in collision and a description of the collisions. A 
25 collision group is a set of objects linked by one or more 
collisions. An object enters a group if it is in collision 
with at least one of the objects of the group. A collision is 
necessarily described by the pair of objects in collision and 
by the location of the collision using either intersecting 

3 0 basic geometrical elements (for example two triangles or two 

surfaces) or a straight line segment joining the two points 
that are locally interpenetrating the most. 

• A third or "contact processor" module is called by the 
"collision detection" module and in return calls the 
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"mechanical" module. For each group of collisions, the 
contact processing module repatriates the physical 
characteristics of the objects and the description of the 
collisions. The module is adapted to determine, in each 
5 instance, the solution to the Signorini problem that governs 
the contact between two objects in the case of pure sliding. 

The invention performs interactive simulation. A 
simulation is defined by the sampling time step of the 
simulated model and by its calculation time step. The method 

10 of the invention uses a calculation time step that is always 
less than the selected sampling time step, so producing an 
interactive simulation in which the user is able to intervene 
directly during the simulation. 

Figure 1 summarizes the main steps of the method of the 

15 invention, which employs a simulation loop using the three 
main modules cited above installed in the Figure 8 computer 
100. Figure 2 shows the various levels of processing between 
objects during the various steps of the simulation method. 

A first processing step 13 0 uses the "mechanical" module 

20 and is situated at the level of each object (object level 3) . 
Information is supplied via a coupling module 12 0 from the 
user interface or haptic interface 110 that determines the 
position and the shape of each object (information 13 5 
generated in the step 130) . 

25 In this first step 130, a modeling process 13 takes 

individual account of each object or tool 201, 202, 203 
without taking account of any subsequent interactions and 
causes the position and the shape of the object to evolve in 
accordance with the forces applied from the user interface 110 

3 0 and where they are applied. 

A second processing step 140 uses the "collision 
detection" module and is situated at the level of an overall 
scene (scene level 4) . The information 13 5 generated in the 
step 130 is used in the step 140 to establish pairs of objects 
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that are detected as intersecting. During the step 13 0 a list 
of groups of collisions (information 145) is generated 
containing a string of objects in collision and a description 
of the collisions. In this step 14 0, a modeling process 14 
5 therefore takes account of a pair of intersecting objects such 
as the objects 201, 202 at the level of an overall scene. 

A third processing step 150 uses the "contact processing" 
module and is situated at the level of an overall scene (scene 
level 5) . The information 145 generated in the step 14 0 and 

10 the information 13 5 generated in the step 13 0 are used to 
determine in each instance the solution to the Signorini 
problem that governs the contact between two objects in the 
case of pure sliding (information 155) . In this step 150, a 
modeling process 15 therefore takes account of the interaction 

15 between two objects such as the objects 201, 202 at the level 
of an overall scene, the physical characteristics of the 
objects and the description of the collisions for each group 
of collisions being repatriated by the "contact processing" 
module . 

20 The third processing step 150 supplies information 155 

concerning forces and where they are applied that is sent to 
the first or "mechanical" module during a fourth processing 
step 160 that is also situated at the level of the objects 
(object level 6) . In this step 160, the result of the real- 

25 time simulation processing may simply be normalized in a 
display step 170 or returned via the coupling module 120 to 
the user interface 110 to provide the user with haptic 
sensation feedback. In this final step, a modeling process 16 
therefore takes individual account of each object or tool 201, 

30 202, 203 as well as taking account of contacts previously 
simulated. 

At the level of the object, in a preferred embodiment, 
the object is described as a set of triangles reproducing its 
surface and a set of tetrahedra for describing its interior, 
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all within a rest configuration. This configuration 

corresponds to the shape of the object when no force is 
applied to it. 

The triangles are advantageously described by three 
5 points, placed in an order such that the computation of the 
normals is invariably directed towards the exterior of the 
object. The surfaces of objects are closed so that an 
exterior can be distinguished from an interior. 

The deformations of the objects are interpolated by the 

10 finite element method using a linear tetrahedral mesh. The 
system can simulate different behavior laws provided that an 
approximate linear relation between the forces exerted and the 
displacements around a local configuration can be extracted 
locally from it for a computation step. 

15 If Uk represents the displacement vector of an object in 

the local frame of reference at a current time t and Uk-i 
represents the displacement vector of the object in the local 
frame of reference in the preceding calculation step t-1, 
then: 

20 

U k =A(U k ,)F k + b(U k ,) (7) 
where : 

A is a matrix defining the deformation of the object at the 
local level , 

F k is a vector representing the external forces applied to the 
object expressed in the local frame of reference, 
b is a vector that has a value in the displacement space and 
depends on the object deformation model, and 

U k _i is a vector whose instantaneous values are known at the 
start of the calculation step of the current time t. 

A distinction is advantageously made between the overall 
movement of the object described by the fundamental 
relationship of the dynamic and the deformation of the object 
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around a current configuration described by the deformation 
law. 

The forces applied to the object are distinguished by 
their explicit or implicit character. An explicit force is 
5 known at the beginning of the computation step and must be 
integrated to determine the movement of the object that it 
produces. Contact forces, on the other hand, are implicit in 
the sense that they depend on the movement of the objects in 
the time step. The explicit forces are therefore integrated 

10 for a time step before proceeding to the overall scene level 
to determine the value of the implicit forces. 

After the explicit forces have been integrated at the 
level of each object, the configuration of the objects in the 
scene is called the "free" shape and position. This 

15 configuration is obtained without intervention of the contact 
forces. Thus a "free movement" is a movement integrating only 
the forces known explicitly at the beginning of the 
computation time step. It is considered below that the free 
movement is the movement obtained over a time step if the 

2 0 contact forces are not integrated. 

The proposed system then uses a collision detection 
process that tests geometrically existing intersections 
between the objects 223, 23 0 in the scene and the preferential 
exit directions of the objects from the collision (Figures 6 

25 and 7) . 

If an object 221 is considered which, in a position 223, 
comes to interact with another object 23 0, the preferential 
direction may be calculated only on the basis of geometrical 
criteria (Figure 6) or may depend on the configuration whereby 
30 the objects 223, 230 came into collision, taking account of an 
intermediate movement 222 of at least one of the objects 
between the preceding calculation step and the current 
calculation step (Figure 7) . 
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In all cases the collision detection process extracts 
from pairs of elements of intersecting objects a length and a 
direction of interference between the two elements. 

In the preferred situation of a description of the 
5 surface of the objects by triangles, an element is a point, a 
segment or the face of a triangle. Collision detection may 
then take into account three canonic cases of intersection 
between two objects: point/triangle intersection, 

segment /segment intersection, and triangle/point intersection. 
10 The process may equally produce a set of object elements 

in proximity that could potentially collide following 
integration of the contact forces. A distance between these 
elements and its direction are then computed. 

All the collision groups of the scene may be constructed 
15 using the description of all the interferences and proximities 
between the objects. Each group is then transferred into the 
contact module . 

After the detection of a collision, processing in the 
contact module determines the configuration of the first 

20 contact between two computation time steps. 

If account is taken of a description of the surface of 
the objects by triangles when an area of interpenetration 
between two objects has been defined at a time T of the 
simulation sampling step, a list of triangles constituting the 

25 pair of objects is extracted. If there are a rigid object and 
a deformable object, the coordinates of the triangle 
representing the deformable object are translated into the 
frame of reference of the rigid object at separate simulation 
sampling times T and T-l. 

30 For all possible triangle/triangle pairs there is 

effected a linear interpolation of the displacement of three 
points Di # D 2 , D 3 of the deformable triangle between the 
initial and final positions at the discrete sampling times T 
and T-l. Three different types of test represented in 
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Figures 3A to 3C may then be effected on the pair comprising a 
deformable triangle 2 0 defined by the vertices D x , D 2 , D 3 and 
having successive positions 21, 22, 23 between the times T-l 
and T and a rigid triangle 3 0 defined by vertices Ri, R 2 , R3 . 
5 Test 1 (Figure 3A) corresponds to the situation in which 

a collision plane is formed by the rigid triangle and 
establishes a constraint on the point concerned of the 
deformable triangle . 

Test 2 (Figure 3B) corresponds to the situation in which 
10 a collision plane is formed by a rigid segment and a 
deformable segment at the collision time t and establishes a 
constraint on two points of the deformable object. 

Test 3 (Figure 3C) corresponds to the situation in which 
a collision plane is formed by the deformable object at the 
15 collision time and establishes a constraint on three points of 
the deformable triangle. 

The invention may be applied equally to collisions 
between a rigid object and a deformable object and to 
collisions between two deformable objects. 

2 0 The contact module is described in more detail below with 

reference to a description of triangular objects. 

The contact module is called as many times as there are 
collision groups in the scene at the computation time. The 
collision detection module has stored in a memory space for 
25 each collision: 

■ the normal , 

• the pair of objects and the elements relevant to the 
collision, and 

• (where applicable) the points of application of the 

3 0 contact force. 

If the collision detection algorithm does not give the 
points of application of the contact force (this is the 
situation of detection without intermediate movement shown in 
Figure 6) , they must be reconstructed and in all events these 
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application points must be interpolated relative to the 
selected deformation module. 

In the preferred case of a description of objects by 
triangles, the problem is split into two cases: there are 
5 either two segment elements or a node element and a face 
element . 

In the case of a segment/ segment intersection between a 
triangle 4 0 defined by vertices Pi, P 2 , P3 and a triangle 5 0 
defined by vertices Q lt Q 2/ Q3 (Figure 4) , the two selected 
10 points 41, 51 are situated at the intersection of each of the 
two segments Q lf Q 2 , respectively Pi, P 2 with the plane formed 
by the face of the other intersection triangle. 

The vector connecting the two points 41, 51 found is 
denoted 8. 

15 In the case of a point/face intersection between a 

triangle 60 defined by vertices P Xt P 2 , P 3 and a triangle 70 
defined by vertices Qi, Q 2 , Q 3 (Figure 5) , the first selected 
point is the point of the intersection and the second is the 
projection of that point onto the face of the intersection. 

2 0 The vector joining the two points found is denoted S. 

The intersection algorithm with intermediate movement 
proposed by Xavier Provot (Collision and self -collision 
handling in cloth model dedicated to design garments, Graphics 
Interface 1997, 177-189) may be used and produces an 
25 approximate configuration between the two triangles at the 
time of the collision. 

Barycentric coordinates are used to distribute the 
displacements and forces at these points in the preferred case 
of linear interpolation for finite element modeling (triangles 

3 0 - tetrahedra) . 

To be able to compute the deformations of the objects 
correctly, non-interpenetration must be guaranteed. 
Interpolation of the elements is therefore used so as to have 
only one force and distance unknown per contact. To simplify 
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the problem, linear interpolation is used for the finite 
elements . 

Thus in the case of a segment /segment contact (Figure 4) : 
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5 where : 

a and 1 - a are the barycentric coordinates of the first 
segment Qi, Q 2 and p, 1 - P those of the second segment Pi, P 2/ 
ai, bi, ci are the coordinates of the normal n± of the triangle 
40, 

10 Wi, W 2 are the coordinates of the first segment Qi, Q 2/ 
V X/ V 2 are the coordinates of the second segment Pi, P 2 . 

In the case of a point /plane contact (Figure 5) , a i7 b i# 
Ci are the coordinates of the normal n± of the triangle 6 0 and 
the interpenetration distance 8 between the triangles 60 and 

15 70 is written: 



(2) 



where : 

a, p, y are the barycentric coordinates on the triangle 6 0 (sum 
= 1), 

2 0 Wi, W 2 , W 3 are the coordinates of the first triangle 60, and 

Vi are the coordinates of the point of contact 71 consisting of 
a vertex Qi of the second triangle 70. 

Exactly the same interpolation is used for the contact 
force . 

25 Once the point of application of the contact forces has 

been found, the mechanical characteristics of the objects are 
transferred into the defined contact space. It is assumed 
below that a group of in contacts with n objects is processed. 

To transport overall mechanical characteristics in the 

3 0 situation where the mass and inertia of the object are lumped 

together at its centre of mass, a conventional Jacobean matrix 
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may be used, as defined in the works of Ruspini (Diego Ruspini 
Sc Oussama, tt A Framework for Multi-Contact Multi-Body Dynamic 
Simulation and Haptic Display", Proceedings of the 2000 
IEEE/RSJ International Conference on Intelligent Robots and 
5 Systems) . Using this matrix, there is an instantaneous 
relationship between the contact forces f c in the contact 
direction and the accelerations 8" c (constrained) and 8" fre e in 
the same direction: 

<5" c = JcM-'jJt+^'ftee (3) 

10 where: 

J c is an m*6n Jacobean matrix that transfers the instantaneous 
linear and angular movement into the contact space, 
M is a block diagonal matrix corresponding to the mass and 
inertia of the n objects of the group of contacts, and 

15 J C T is the transposed matrix of J c . 

The interpolation defined for the triangles may be used 
to transport the local characteristics. There is therefore a 
relationship between the displacements of the points of the 
deformable mesh and the displacements in space of the 

20 contacts, and the same interpolation may be used between the 
contact forces and the forces at the nodes. 

Returning to the linear instantaneous relationship 
characterizing the deformations: 

8 C = [z i=1 n N c i A (U k _,) (N c y ] / c + dfr ee (6) - 

2 5 where Nc 1 represents the matrix for passing from the 

displacement space of the mesh to the displacement space at 
the contact points and A is a matrix as defined above. 

The contact modeling process selected obeys the laws of 
physics as much as possible. By way of simplification, it is 

3 0 nevertheless preferable to consider that the contact 

directions will not change during the solution of the 
computation even if this is not strictly the case in practice. 
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The first postulate of the Signorini problem is that 
there is no interference between the objects if they are solid 
(their materials do no mix) . Thus after the solution of the 
problem a positive or zero displacement is required at the 
5 contact point: 

S Q >0 (9) 

The second postulate is that the situation is one of 
contact without friction, so that the contact force is 
directed along the normal : 

10 f c >0 (10) 

The third postulate is that the contact force is non-zero 
(f c * 0) if and only if there is really contact (S c = 0) . This 
produces a complementary relationship between the two vectors: 

5 c l/ c (11) 

15 The transport of the mechanical characteristics is used 

to make it possible to solve the Signorini problem. The 
effects of the local and overall characteristics are summed by 
integrating the accelerations to yield exclusively a 
relationship between displacement and force in the contact 

2 0 space. 

In order to integrate the accelerations, it is 
advantageous to use a numerical method that tends to ensure 
conservation of energy, like the trapezium method (also known 
as the Tustin method) , and this may be expressed in the 
25 following form if a magnitude X is considered at times t(X t ) 
and t+1 (X t+ i) : 
X t+I = X t + '/ 2 dt (X/ + X t+1 ' ) 
X t+1 ' = X t ' + Y 2 dt (X t " + X t+1 " ) (12) 

Using the above numerical method and equations (4) and 

3 0 (5) , the following relationship is obtained: 

S c = [>/4 dt 2 J c M" 1 J c T +£ i=1 n N c < C (U k .,) (Ne 1 ) 1 ] /.+ Sfree (13) 

The coefficient 1/4 may be different if a different 
method of integrating the accelerations is used. 
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If the mechanical model selected has no overall 
characteristics and if the mass and inertia are integrated in 
the deformation model at the local level, only equation (5) is 
used, which already implicitly includes numerical integration 
5 over time. 

S c = [s i=1 n N C J A (U k .,) (Ne 1 ) 7 ] f c +Sfree ( 6 > 

The postulates defined in the Signorini problem and the 
instantaneous linear equation creating a linear relationship 
between contact forces and displacements in the contact space 

10 mean that the contacts may be formulated in linear 
complementarity problem (LCP) form. There are numerous 

algorithms for solving this type of problem (see for example 
Murty, K.G., Linear Complementarity, Linear and Nonlinear 
Programming, Internet Edition (1997)) that are able to solve 

15 the problem in a time compatible with the performance required 
by haptics. For example, a computation may be performed at a 
frequency of the order of 500 Hz to 1000 Hz for a reasonable 
number of contacts (for example 30 to 40 contacts) using the 
main Pivot algorithm on a 2 GHz Pentium IV type PC. 

2 0 Figure 3 shows the interaction between a deformable 

object 80, such as forceps, and another object 90. In this 
case, the deformable object 80 is virtually attached to the 
haptic interface (as soon as it is held by the user) in an 
area of a node O defining a frame of reference Ox 0 y 0 Zo- 
25 Dirichlet conditions may be applied to such points. 

In each simulation step, the free movement configuration 
yields a contact space. An LCP solution gives the non-zero 
contact forces f± and a constrained movement is deduced 
therefrom. These forces (illustrated by the normal Ui with 

3 0 coordinates a ± , b ± , c ± in Figure 9) are transported to the 

point O to create the force and the torque at the haptic 
interface . 

Figures 10A to 10C show the example of a deformable 
object 80 consisting of a clip fitted to a tube 91. Different 
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deformations of the clip 80 are seen at different positions 
81, 82, 83 relative to the tube 91. 



